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Abstract 

We present a study of Z^ + X production in pp collisions at y/s = 1.8 TeV from 97 (87) 
pb _1 of data collected in the eej (fifij) decay channel with the D0 detector at Fermilab. The 
event yield and kinematic characteristics are consistent with the Standard Model predictions. 
We obtain limits on anomalous ZZj and Z77 couplings for form factor scales A = 500 GeV 
and A = 750 GeV. Combining this analysis with our previous results yields 95% CL limits 
|Af | < 0.36, \h% \ < 0.05, \hj \ < 0.37, and \hj \ < 0.05 for a form factor scale A = 750 GeV. 
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Abstract 

We present a study of Z7 + X production in pp collisions at =1.8 TeV 
from 97 (87) pb _1 of data collected in the eej (p^j) decay channel with 
the D0 detector at Fermilab. The event yield and kinematic characteristics 
are consistent with the Standard Model predictions. We obtain limits on 
anomalous ZZj and Z77 couplings for form factor scales A = 500 GeV and 
A = 750 GeV. Combining this analysis with our previous results yields 95% 
CL limits |/if | < 0.36, \hf \ < 0.05, \hj \ < 0.37, and \hj \ < 0.05 for a form 
factor scale A = 750 GeV. 
Studies of vector boson pair production and measurements of the trilinear gauge boson 
couplings provide important tests of the Standard Model (SM) of electroweak interactions. 
The SM predicts no tree-level couplings between the Z boson and the photon. Observation 
of such couplings would indicate the presence of new physical phenomena. Recent limits on 
the ZZj and Z77 coupling parameters have been obtained by CDF 0, L3 0, DELPHI 
and D0 

In the SM, the £ + £~7 final state can be produced via radiative decays of the Z boson or 
by production of a boson pair via t- or u-channel quark exchange. The former process is the 
dominant source of events with small opening angle between the photon and charged lepton 
and for events with a low value of photon transverse energy, E^- Events produced by the 
latter process have lepton-pair invariant mass, m«, close to Mz and three-body invariant 
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mass, rnu-y, larger than Mz- Anomalous ZZ7 or Z77 couplings would enhance the cross 
section for Z7 production, particularly for high-.&r photons, relative to the SM expectations. 

A study of Z'-f production and a search for anomalous Z7 couplings has been performed 
using the reactions pp —>■ eejX and fifi'jX at y/s = 1.8 TeV in data collected with the 
D0 detector at Fermilab during the 1993-1995 Tevatron run. These data correspond to 
an integrated luminosity of 97 ± 5 (87 ± 5) pb _1 in the eej (nf-ij) channels. This study 
is complementary to that of Ref. J5J, which sets limits on anomalous ZV'y (V = Z,j) 
couplings using a fit to the Ej- spectrum in events analyzed with the Z — > vv hypothesis. 
The sensitivities to anomalous couplings are equivalent based on the expected event yields 
and Ej, spectra. The backgrounds are dissimilar and the signal-to-background ratio is much 
higher in the charged-lepton analysis. Also, the kinematic characteristics of the charged- 
lepton events can be studied in detail. 

The results of the search for anomalous couplings are presented within the formalism of 
Ref. [[J, which assumes only that any possible trilinear ZV7 coupling must obey Lorentz 
and gauge invariance. In this formalism, the most general ZVj vertex contains four unde- 
termined coupling parameters hj (i = 1, ... ,4). Terms proportional to Yi{ and h\ in the 
scattering amplitudes are CP-odd, while those proportional to h\ and h\ are CP-even. To 
ensure partial wave unitarity at high energies, a form factor ansatz (s) = hf / (1 + s/A 2 ) ni 
is used 0, where \/I is the parton center-of-mass energy, hf is the value of hf in the low- 
energy limit s = 0, A is a mass scale, and is the form factor power. Form factor powers 
of Hi — n 3 — 3 and n 2 = n 4 = 4 were used. These choices of provide the terms in the 
amplitude proportional to hj with same high energy behavior. 

The D0 detector, described in detail in Ref. 0], consists of three main systems: the 
inner tracker, the calorimeter, and the muon systems. A nonmagnetic central tracking sys- 
tem, composed of central and forward drift chambers, provides directional information for 
charged particles and is used in this analysis to discriminate between electrons and pho- 
tons and in muon identification. Particle energies are measured by a liquid-argon uranium 
sampling calorimeter that is divided into three cryostats. The central calorimeter (CC) 
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covers pseudorapidity \r)\ < 1.1, and the end calorimeters (EC) cover 1.1 < \rj\ < 4.4. The 
EM (hadron) calorimeters are divided into four (four to six) layers to measure longitudinal 
shower development. Energy resolutions of approximately a(E)/E = 15%/\/E © 0.4% (E 
in GeV) are achieved for electrons and photons. The muon system consists of magnetized 
iron toroids with one inner and two outer layers of drift tubes and achieves a momentum 
resolution of <r(l/p) = 0.18(p - 2)/p 2 © 0.003 with p in GeV/c. 

Data were collected with a multi-level trigger system. The ee7 candidates were required 
to contain two EM clusters with Et > 20 GeV. The trigger efficiency was estimated to 
be nearly 100% for events that satisfied the offline e&y selection criteria given in the next 
paragraph. The /x/ry candidates were required to have at least one muon within \r)\ < 1 and 
Pt > 8 GeV/c and to have an EM cluster with Et > 7 GeV. The trigger efficiency ranged 
from 60% to 90% depending on E T and on whether the event passed the tight or loose muon 
selection described below. 

Events which satisfied the trigger requirements were subjected to further selection cri- 
teria. Each eey event was required to have two electron candidates with Et > 25 GeV 
and a photon candidate with Et > 10 GeV within the fiducial region \rj\ < 1.0 (CC) or 
1.5 < \r]\ < 2.5 (EC). Of the two electron candidates, one was required to have a matching 
track, and the other was required to have a track or drift chamber hits associated with the 
electromagnetic shower. The photon was required to have no matching track and no drift 
chamber hits nearby. 

Two samples of /i/ry candidates were identified. The events identified using the tight 
selection criteria were required to have a photon, and two isolated muon tracks in the region 
\r)\ < 1. The events identified using the loose selection criteria were required to have: a 
photon; an isolated muon track in the region \rj\ < 1; and a muon identified |8||| by a 
pattern of isolated energy deposition in the longitudinal segments of the hadron calorimeter 
in the region \rj\ < 2.4, with an azimuth, <fr, within 0.4 radians of the direction of the missing 
transverse energy corrected for the Pt of the tracked muon. In the tight selection, one 
muon was required to have pt > 15 GeV/c and the other to have pt > 10 GeV/c. In 
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the loose selection, the muon with a track was required to have pt > 15 GeV/c. In both 
selections the opening angle between the muons was required to be between 40 and 160 
degrees. Also, the photon candidate was required to be within the fiducial region \rj\ < 1.1 
(CC) or 1.5 < \r]\ < 2.5 (EC), to have Et > 10 GeV, and not to have a matching central 
detector track. 

An angular separation of IZ^ = y/Ar/ 2 + A0 2 > 0.7 was required between the photon 
and the electrons or muons. This reduces the number of radiative Z — > £ + £~7 decay events 
in the final sample while maintaining sensitivity to ZV^y couplings. 

The efficiencies for the above selection criteria were estimated using Z — > ee and Z —>■ 
candidates in the data. For electrons, the detection efficiency was measured to be about 
80% when a track match was required. When only drift chamber hits were required, the 
efficiency increased to about 90%. Including the geometrical acceptance, the muon tracking 
and reconstruction efficiency was 41 ± 2% for < 1.0, and 80 ± 2% (64 ± 3%) for muons 
identified by the calorimeter with \rj\ < 1.1 (1.1 < \rj\ < 2.4). The overall acceptance of 
the loose /i/ry selection criteria was 3.2 times greater than that of the tight /i/i7 selection 
criteria. The photon efficiency was found to depend on Et and r], and ranged from 35% 
for EC photons at E T = 10 GeV to approximately 70% for CC photons with E T > 25 
GeV. The efficiency of the veto against photons with drift chamber hits or tracks in close 
proximity, used in the eey analysis, ranged from 80% in the CC to 60% in the EC. The 
energy dependence of the photon detection efficiency, due to the effects of the underlying 
event and noise, was estimated from photons simulated with geant [[K]] superimposed on 
minimum bias data collected during the run. 



A parametric detector simulation [11] along with a leading-order MC event generator || , 



was used to predict the signal as a function of the couplings hj . A K-factor of 1.34 || was 
used to correct the predicted cross section for processes not included in the leading-order 
calculation. Additionally, the iij system was given a transverse momentum according to 
the theoretical prediction for Z boson production |T2] to simulate kinematic effects [13] not 



included in the event generator. Parton densities were taken from the MRSD— ' set [14 



A total theoretical uncertainty of 6% is assigned to the signal prediction. This uncertainty 
reflects the variation in predicted signal for Q 2 scales in the range s/4 < Q 2 < As using 
recently fitted parton densities. 

With an integrated luminosity of 97 (87) pb -1 , the expected SM ecy (/i/ry) signal is 
13.2 ± 1.3 (16.3 ± 2.0) events. The contributions to the systematic uncertainty on this 
prediction, listed in Table 1, total 10% (12%). 

The major source of background in the electron decay channel is Z+jets production with 
a jet misidentified as a photon. Contributions from multijet and direct photon (7+ jets) 
processes in which one or more jets are misidentified as an electron or photon are smaller 
but not negligible. Similarly, the major background for the muon decay channel is Z + jets 
production. The sample selected with the loose selection criteria also includes substantial 
background from W + jets with a fake muon and a jet misidentified as a photon. 

The probability for a jet to be misidentified as a photon was measured from an indepen- 
dent sample of multijet events. After subtracting the expected number of direct photons in 
the sample, the misidentification probability was found to depend slightly on Ej, and 
was estimated to be ~ 10~ 3 . A systematic uncertainty of 25% assigned to -Pj_» 7 accounts for 
the uncertainty in the direct photon fraction of the multijet sample. The electron misiden- 
tification probability Pj^ e was measured in a similar way and was found to be about half 
of Pj-> 7 - The backgrounds in the ee^X and iifi^X candidate samples were estimated by 
weighting eejX, fifijX, and ejjX events in the parent sample by the appropriate Pj-^ and 
Pj^e factors. The background from events with jets misidentified as electrons or photons 
is 1.81 ± 0.54 events for the eej channel, 0.29 ± 0.08 events for the tight /x/ry channel, and 
1.89 ± 0.54 events for the loose ///ry channel. 

Contributions from processes such as — > t + t~7 and WZ — > iiev were investigated 
and found to be negligible for the eej channel and for the /i/ry channel selected with the tight 
criteria. However, the /i/ry sample selected with the loose selection criteria has backgrounds 
of 1.11 ± 0.30 events from W'y — > /iz/7 + X, 0.28 ± 0.08 events from Z — > tt — > fie + X, and 
0.013 ± 0.002 events from WW and tt — > /ie + X, which arise because of a fake muon. The 
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probability for fake muons was measured using the Z — > ee and Z — > fifi data. 

In the data 14 (15) ee7 (fifty) candidate events were identified. Four of the fifiy events 
were from the tight selection criteria and 11 were from the loose selection criteria. The 
predicted total background is 1.81 ± 0.54 (3.57 ± 0.68) events in the eey (fifty) channel. 
Thus, the measured signal is 12.2 ± 3.8 (11.4 ± 3.9) events. The total is consistent with the 
predictions of the SM, the contributions from the individual channels. 

The kinematic distributions of the candidates are shown in Fig. [I], along with the cor- 
responding background distributions. Figure |l](a) shows the spectrum of the combined 
electron and muon channels. The spectrum is consistent with the expectation of the SM. 
Figures 0(b) and 0(c) show the dielectron invariant mass and dielectron-photon invariant 
mass, respectively. Two eey events were observed with E^ « 75 GeV, dielectron invariant 
mass M ee « Mz, and dielectron-photon invariant mass M ee7 « 200 GeV/c 2 . Assuming SM 
Zy production, the probability of observing two or more events with Ej, > 60 (70) GeV in 
the combined electron and muon channels is 15% (7.3%). The SM Monte Carlo indicates 
the most likely eey mass for events with Ej, in the range 70 to 79 GeV is 200 GeV/c 2 . Thus 
the two events can be understood as a fluctuation of SM Zy production. Note that the di- 
electron mass distribution shows indications of the predicted two-peaked structure induced 
by the photon Et threshold and the ey opening angle selection criteria used to suppress 
the radiative events. The number of Zy production candidates with M ee > 83 GeV/c 2 and 
M ee7 > 100 GeV/c 2 is consistent with the SM prediction. The plots analogous to Figs. [L](b) 
and |l|(c) for the muon channel show agreement with the SM predictions, but the detailed 
structure seen in the electron channel plots is obscured by the limited momentum resolution 
of the muon system. 

Limits on the ZVy couplings were extracted from the data by performing an unbinned 
likelihood fit to the Ej. distribution that utilized both the shape of the photon spectrum 
and the total event yield. The likelihood function was convoluted with Gaussian probability 
distributions to account for the systematic uncertainties. With the constraint that only one 
coupling be nonzero at a time (ID), the 95% confidence level (CL) limits are |/if | < 1.31, 
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I^fol < 0.26, \h1 \ < 1.36, and \hj \ < 0.26 for a form factor scale A = 500 GeV. Contours for 



the 95% CL two-dimensional (2D) limits |D| on the CP-even ZZ^ and Z77 coupling pairs 
(where two of the anomalous couplings are allowed to vary at the same time) are shown 
in Figs. |(a) and |(b). With A = 750 GeV, the ID limits are |Af | < 0.67, \hf \ < 0.08, 

I < 0.69, and \hj \ < 0.08. The 2D limits for A = 750 GeV are slightly looser than 
the unitarity constraints. The limits on the CP-odd couplings are nearly identical to the 
corresponding limits on the CP-even couplings. These are the most restrictive limits available 
from the e&y and /i/i7 final states. Though the studies have equivalent sensitivities, limits 
from this analysis are less restrictive than those of Ref. || because of the observed event 
yields and Ej, spectra. 

Combining these results with our previous measurements ||,[| yields 95% CL ID limits 

\hf \ < 0.36, \hf \ < 0.05 {hj = 0) 

\tq \ < 0.37, |^ | < 0.05 (hf = 0) 

for A = 750 GeV. These combined limits are 20% tighter than the previous most restrictive 
combined limits [|TBJ. Figures 0(c) and |2|(d) show the two-dimensional limits on the ZZ'-f 



and Z77 couplings from the combined analyses. 

In conclusion, a search for anomalous Z-photon couplings was performed by studying 
ee^X and fi^X production using the D0 detector. A total of 14 (15) ee^yX (/zjiryX) 
candidate events were observed, in agreement with the 13.2 ± 1.3 (16.3 ± 2.0) signal events 
predicted by the SM and the expected background of 1.81 ± 0.54 (3.57 ± 0.68) events. The 
photon transverse energy spectrum, the dilepton invariant mass, and the ££7 invariant mass 
are as expected from the predictions of the SM and provide evidence of Z'j pair production. 
Limits on anomalous ZZ'-y and Z77 couplings were derived. These results, combined with 
our previous measurements, provide the most stringent constraints on anomalous ZZ7 and 
Z77 couplings available. 
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FIG. 1. Kinematic distributions for candidates and background estimates: (a) photon trans- 
verse energy for the combined ee^f and fifi^f samples, (b) dielectron invariant mass, (c) dielec- 
tron-photon invariant mass. 
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FIG. 2. Two-dimensional limits (a) on h§ vs. /if , and (b) on hj vs. /i^g from the ee(fj,n)j 
analyses and the same, (c) and (d), from combining this analysis with previous results from this 
experiment. Only the couplings varied in each plot are assumed to be different from the SM values. 
Unitarity limits are indicated by the dashed contours. 
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TABLES 



Channel 


ee7 


W»7 


PDF choice, Q , fc- factor 


6% 


6% 




1% 


-i fir" 

1% 


££7 selection efficiency 


2.3% 


6.3% 


Photon conversion rate 


5% 


5% 


Random overlap rate 


3% 


3% 


Luminosity 


5.3% 


5.3% 



Total: 10% 12% 



TABLE I. Summary of the systematic uncertainties for the predicted pp — > ee7 and ^/ry signals. 
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